Vaccine 32 (2014) 284-289 



ELSEVIER 


Contents lists available at ScienceDirect 

Vaccine 

journal homepage: www.elsevier.com/locate/vaccine 


N^accine 


Timeliness of infant vaccination and factors related with delay in 
Flanders, Belgium 



CrossMark 


Tinne Lernout 3 ’*’ * 1 , Heidi Theeten 3 ’ 13 ’ 1 , Niel Hens c ’ d , Tessa Braeckman 3 , 

Mathieu Roelants e , Karel Hoppenbrouwers e , Pierre Van Damme 3 

3 Centre for the Evaluation of Vaccination, Vaccine and Infectious Disease Institute, University of Antwerp, Antwerp, Belgium 
b Post-doctoral Research Fellow of the Fund of Scientific Research (FWO), Belgium 

c Centre for Health Economic Research and Modelling Infectious Diseases, Vaccine and Infectious Disease Institute, University of Antwerp, Antwerp, Belgium 
A Interuniversity Institute for Biostatistics and statistical Bioinformatics, Hasselt University, Diepenbeek, Belgium 
F Centre for Youth Health Care, Department of Public Health and Primary Care, KU Leuven, University of Leuven, Belgium 


ARTICLE INFO 


ABSTRACT 


Article history: 

Received 12 September 2013 
Received in revised form 23 October 2013 
Accepted 24 October 2013 
Available online 16 November 2013 


Keywords: 

Infant vaccination 
Timeliness 
Risk factors 
Flanders 


Achieving high vaccination coverage is a necessary, but not a sufficient indicator of the quality of a 
vaccination programme, in terms of control and prevention of childhood infectious diseases. For optimal 
protection of infants, timeliness of vaccination is increasingly recognized as another important target. 

The aim of this study was to assess the timeliness of measles-mumps-rubella (MMR) and diphtheria- 
tetanus-pertussis (DTP) vaccination in infants in Flanders (Belgium), and to identify predictors of 
vaccination delay. The timeliness was assessed using the Kaplan-Meier estimator in three consecutive 
vaccination coverage surveys among children aged 18-24 months, conducted in 2005, 2008 and 2012, 
respectively. Factors associated with delayed administration of the vaccines were identified using Cox 
regression analysis. 

Over the time period, vaccination coverage for the first dose of MMR ranged from 94.0 to 96.6% and for 
the third dose of DTP from 97.9 to 98.7%. However, up to 32% (for MMR1) and 95% (for DTP3) of infants 
received vaccine doses delayed according to the recommended schedule. Although some improvement 
was achieved over the last decade, further efforts are needed to reach risk groups with delays, more 
specifically children vaccinated outside the baby well clinics, born from a mother originating from outside 
the European Union, children with a higher ranking or in families with a lower income. 

© 2013 Elsevier Ltd. All rights reserved. 


1. Introduction 

To achieve effective control of vaccine-preventable infectious 
diseases, a high coverage with efficacious vaccines is a prerequisite. 
The global target of the World Health Organization (WHO) for the 
vaccination coverage in infants is 90% [1]. For the elimination of 
measles and rubella, which is an additional goal in the American 
and European WHO regions, an even higher coverage is required 
[ 2 ]. 

In addition to obtaining high coverage, timely vaccination is of 
critical importance for reducing disease risk. Delayed infant vacci¬ 
nation enlarges the gap between loss of protection from maternal 
antibodies and full protection from vaccine-induced immunity, 
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negatively affects herd immunity and postpones full protection in 
infants and children. As a consequence, infants are longer vulnera¬ 
ble to vaccine preventable diseases, such as Bordetella pertussis and 
measles, contributing to outbreaks of the latter in various countries 

[3,4]. 

Vaccination coverage is the most frequently used indicator for 
the evaluation and monitoring of vaccination programmes. How¬ 
ever, age-specific infant vaccination coverage, e.g. at the age of 
18-24 months, provides no information on possible delays of 
vaccine-administration. Timely vaccination can be assessed from 
cross-sectional survey data through a time-to-event analysis using 
the Kaplan-Meier estimator [5-8], 

Recommendations on the Belgian infant immunisation sched¬ 
ule are published by the national Superior Health Council (SHC) [9], 
In Flanders, the northern region of Belgium which represents about 
60% of the population, surveys repeatedly showed high coverage 
estimates for vaccines recommended in infancy. In 2012, coverage 
rates were >92% for all infant vaccinations, and above 95% for the 
first dose of measles-mumps-rubella vaccine (MMR1) [10]. Infant 
vaccines are mostly administered at well baby clinics (under-5 
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clinics) (83.7% of vaccines in 2012), or by a family physician or 
paediatrician (15.6%). 

The current study focuses on adherence to age recommenda¬ 
tions for infant vaccination against measles and pertussis, since 
both diseases have caused infant cases in Flanders recently, despite 
high vaccination coverage [11-13], The study also aimed to detect 
trends over 3 coverage studies in the past 7 years, and to iden¬ 
tify subpopulations of infants who are at higher risk for delayed 
vaccination. 

2. Methods 

2.1. Study population and survey design 

The present study is based on data from three cross-sectional 
EPI-surveys, conducted in 2005, 2008 and 2012 in Flanders 
[10,14,15]. Each survey used the same study design. Infants 18-24 
months of age were selected with a two-stage random clus¬ 
ter design. First, 125 clusters (municipalities) spread over the 5 
provinces in Flanders were randomly selected with proportionate 
probability to their size. In each cluster, the requested number of 
children were then randomly selected from the National register of 
residents. Sample sizes were calculated based on the latest avail¬ 
able coverage rates for each study, considering a design effect of 1.5 
(2008, 2012)-2 (2005), a margin error of the confidence interval of 
2.5% and a drop-out rate of 10%. The number of participants was 
1354 in 2005 (participation rate 92.2%), 915 in 2008 (91.3%) and 
874 (92.4%) in 2012. 

The design and methods of these studies have been described 
in detail elsewhere [10,14,15], In summary, parents or caregivers 
were visited at home by a professional interviewer, trained on 
the questionnaire and interpretation of vaccination data by the 
researchers. 

Immunisation dates were transcribed from vaccination cards 
and completed or validated through Vaccinnet, the electronic vac¬ 
cine ordering and registration system set up in Flanders in 2006 
(for the 2008 and 2012 surveys) [16]. Further missing data were 
completed with information in medical files, as far as they could 
be consulted. Demographical data (age of the child, gender, rank 
within the family and number of siblings, number of past ill¬ 
ness episodes) and socio-economic characteristics of the parents 
(family income, single parentage, parental age, employment sta¬ 
tus, educational level and ethnicity) were collected through a 
structured interview. The main vaccinating physician (well baby 
clinic, paediatrician, family physician) was defined as the one who 
had administered the majority of vaccine doses. Each survey was 
approved by the respective ethics committees of all universities 
involved and by the privacy commission of the Belgian Govern¬ 
ment. Written informed consent was obtained from a parent or 
legal guardian of each infant included in the study. 

2.2. Outcome measures 

In a first analysis, vaccinated children were classified by the level 
of delay in vaccination for MMR1 and the three doses of diphtheria- 
tetanus-pertussis (DTP1, DTP2, DTP3), according to the schedule 
recommended by the SHC. The recommended age of vaccination 
for MMRl in Belgium is 12 months of age, and DTP doses are rec¬ 
ommended at 8,12 and 16 weeks (2, 3 and 4 months in 2005). 

Time-to-event analysis was used to further analyse the age at 
administration and risk factors for delayed vaccination for the vac¬ 
cines studied. 

First, a Kaplan-Meier survival analysis was applied to the 2005, 
2008 and 2012 surveys to estimate the age-specific coverage rates 
and 95% confidence intervals with censoring of children who had 


not yet received the respective dose at the time of the interview (for 
2005, the start of the study was used because the interview date was 
not registered) [ 6 [. The response of interest was time to vaccination, 
which was calculated in weeks. Timely vaccination was defined as 
occurring within 6 days of the recommended age for DTP and 30 
days for MMRl. 

In a second step, risk factors for delayed vaccination were iden¬ 
tified using a Cox proportional hazard (PH) regression model. We 
opted to use continuous time-to-event analysis and not to cate¬ 
gorize delay of vaccination, since categorizing would impact on 
the associations and up to now there is insufficient evidence to 
state which level of delay impairs vaccine effectiveness. The hazard 
expresses the rate for a child to be vaccinated at a specific moment 
in time. Reciprocal hazard ratio (1 /HR) was used to present a higher 
risk to be vaccinated at a later age compared to the reference group 
(if HR> 1). Cox PH regression models used the socio-demographic 
variables from the interview as possible predictors. To avoid co¬ 
linearity for parental characteristics, only maternal factors were 
included in the analysis (except when only information on the 
father was available). 

2.3. Statistical analysis 

Cluster effects arising from the sample design were controlled 
for using the method developed by Ying and Wei [17,18], The valid¬ 
ity of the proportional hazard assumption, which is a condition for 
Cox regression analysis, was evaluated using Schoenfeld residuals 
[ 19]. Variables were omitted by backward stepwise selection, based 
on significance level (p-value >0.1). Associations were considered 
statistically significant if the p-value was <0.05. Kaplan-Meier anal¬ 
ysis was performed using SPSS 20.0 and R 2.15.1 was used for the 
Cox regression analysis. 


3. Results 

3.1. Timeliness of vaccination 

Respectively 62%, 69% and 72% of infants received MMRl before 
the age of 13 months (56 weeks) in 2005, 2008 and 2012 (Table 1). 
The largest reduction in delay over the 7 years study period was 
observed for doses administered more than 2 months after the 
recommended age. 

Recommendations for administration of pertussis containing 
vaccines (DTP) are less well followed. The majority of children were 
vaccinated with a delay of 1-4 weeks, and the delay increases for 
subsequent doses, up to more than 2 months for 10% of DTP3 vac¬ 
cinations. However, the proportion of timely administered doses 
also increases over the study period, especially for DTP1. 


3.2. Coverage by age from Kaplan-Meier analysis 

Estimates of vaccination coverage by age (inverse survival 
curves) were plotted in Fig. 1. The curves for DTP1 and DTP2 were 
similar to those for DTP3 and are not presented. 

An MMRl coverage of 95% was reached at 99 weeks of age in 
2005, 77 weeks in 2008 and 75 weeks in 2012. The 2008 and 2012 
plots show a higher maximum and a more outspoken rectangular 
shape compared to the 2005 graph, which reflects a higher adher¬ 
ence to age recommendations. 

Coverage by age for DTP3 reached 95% at 38,32 and 30 weeks of 
age in the consecutive studies. A small improvement in adherence 
to age recommendations for DTP3 vaccination is observed between 
2005 and 2008, but not anymore from 2008 to 2012. 
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Table 1 

Vaccination coverage and timeliness of administration for MMR and DTP vaccines in children 18-24 months in Flanders, 2005, 2008 and 2012 (in % of total number of 
children). 


Vaccine 

Year 

Coverage 18-24 months (95% Cl) 

Not delayed 

1-4 weeks too late 

1-2 months too late 

>2 months too late 

MMR1 

2005 

94.0 (92.6-95.3) 

61.6 

NA 

22.1 

10.3 


2008 

96.6 (95.2-97.6) 

69.2 

NA 

20.7 

6.8 


2012 

96.6 (95.1-97.6) 

72.4 

NA 

19.3 

4.9 

DTP1 

2005 

98.7 (98.1-99.3) 

23.7 

64.3 

6.9 

3.8 


2008 

99.3 (98.5-99.7) 

25.2 

68.7 

3.2 

2.2 


2012 

99.5 (98.7-99.8) 

37.8 

56.4 

3.4 

1.9 

DTP2 

2005 

98.2 (97.4-99.0) 

8.4 

71.1 

12.7 

6.0 


2008 

98.6 (97.6-99.2) 

9.0 

77.0 

9.1 

3.5 


2012 

99.1 (98.2-99.6) 

15.3 

69.8 

9.7 

4.3 

DTP3 

2005 

97.9 (97.0-98.8) 

2.9 

60.8 

21.6 

12.6 


2008 

98.3 (97.2-98.9) 

3.6 

61.4 

23.2 

10.1 


2012 

98.7 (97.6-99.3) 

6.4 

61.7 

19.3 

11.3 


N= 1354 in 2005, 915 in 2008 and 874 in 2012. 

Not delayed = within 6 days of the recommended age for DTP1 -3 and 30 days for MMR1. 


3.3. Factors related with delayed administration 

The main determinants of age of administration of DTP and/or 
MMR vaccines in the 2012 survey were the infants’ rank in the fam¬ 
ily, the mother’s origin, the family income and the main vaccinator 
(Table 2). The results for DTP2 were comparable to those for DTP3 
and are not presented. 

Children were vaccinated at a later age when vaccinated outside 
a well baby clinic, when their mother was born outside the Euro¬ 
pean Union or when their birth order was higher (except for DTP1). 
Having a younger mother was also associated with delayed vacci¬ 
nation, although the effect was limited. A lower family income was 
associated with delayed DTP3 vaccination only. For both MMR and 
DTP, the strongest association was found with the main vaccinator. 

The child’s province of residence, gender, number of past ill¬ 
ness episodes, possible switch between vaccinators during the 


vaccination course as well as the mother’s level of education and 
employment status did not significantly influence the age of vacci¬ 
nation. 

Results from the 2005 and 2008 surveys (not shown) confirmed 
the influence of the main vaccinator and the child’s rank in the 
family as the most important characteristics associated with delay, 
as well as an association with the age of the mother. 

4. Discussion 

4.3. Timely administration of vaccines 

Several recent studies highlighted the need of assessing timeli¬ 
ness of vaccination in addition to measuring up-to-date vaccination 
coverage since simply considering immunisation levels at a given 
age may overestimate protection in the population of interest 



Fig. 1 . Age-related coverage for DTP3 and MMR1 vaccines in the study cohorts, Flanders, 2005,2008 and 2012. 
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Table 2 

Hazard ratio’s (and 95% Cl) for delayed vaccination according to determining factors (Cox proportional hazard regression, final models) for DTP1, DTP3 and MMR1, Flanders, 
2012 . 


Determining factor 

Subcategory 

DTP1 

DTP3 

MMR1 

Child’s rank 

Single 

First 

Second 

Third 

4th or higher 


i 

0.99 (0.76-1.28) 

1.07 (0.90-1.26) 

1.42(1.12-1.80)** 

1.47 (1.05-2.06)* 

i 

1.05(0.81-1.36) 

1.29(1.09-1.52)** 

1.56(1.22-1.98)*** 

2.28(1.61-3.22)*** 

Family 

2 biological parents 

Single or reconstituted 



1 

1.30(0.95-1.78) 

Mother’s age (increasing) 



0.98 (0.97-0.99)* 

0.98 (0.97-0.99)* 

Mother’s origin 

Belgium 

Other EU 

Outside EU 

i 

1.14(0.86-1.51) 

1.40(1.17-1.69)*” 

1 

0.94 (0.70-1.25) 

1.29(1.04-1.59)* 

1 

0.90(0.67-1.21) 

1.29(1.07-1.57)** 

Family income 

<1500€ 

1500-2000€ 

2001-3000€ 

>3000€ 

Unknown 

Refused to mention 


1 

0.87(0.60-1.29) 

0.64 (0.46-0.88)** 

0.63 (0.46-0.87)** 

0.90 (0.60-1.33) 

0.74 (0.50-1.11) 


Main vaccinator 

Well baby clinic 

Paediatrician 

General practitioner 

Outside Flanders 

1 

1.08(0.87-1.34) 

2.12 (1.44-3.13)”* 
2.72 (1.10-6.71)* 

1 

1.37(1.10-1.71)** 

1.97(1.34-2.90)*** 

2.47(1.00-6.12) 

1 

1.98(1.58-2.48)*** 

2.54(1.69-3.82)*** 

3.36(1.21-9.32)* 


HR printed in bold are significant with *p< 0.05; **p< 0.01; ***p< 0.001. 
EU, European Union. 


[7,20,21 ]. Coverage rates of 95% estimated at 18-24 months of age 
might not be sufficient to assure adequate protection of infants, 
especially for pertussis and measles. This is also the case in Flan¬ 
ders, although we could demonstrate that rising infant coverage 
was associated with increasing timeliness of vaccination. 

Based on survey data from children born in 2003, 2006 and 
2010, we showed that timely administration of MMR vaccinations 
in infancy increased with 10% over the last decade in Flanders. 
This evolution might partially be the result of increased attention 
for timely vaccination in well baby clinics in Flanders, as well as 
awareness campaigns conducted in Flanders, such as the Euro¬ 
pean Immunisation Week in 2008, which was entirely dedicated 
to measles vaccination. However, measles is still a cause of con¬ 
cern in Belgium 11,12] and the timeliness could achieve higher 
levels if further efforts are made for those children vaccinated with 
a delay of 1-2 months only. Reaching 95% vaccination coverage as 
early as possible in the young population might be a step forward 
to measles elimination [2], From the age of 6 months up to their 
second birthday, children in a study cohort in Switzerland, where 
measles outbreaks occurred in the last decade, spent on average 
266 days unvaccinated and susceptible to measles. One third of 
these 266 days was due to delayed vaccination [20], 

Adherence to the age recommendations is harder to achieve 
for DTP than for MMR since these recommendations are much 
stricter (within 6 days). This is reflected in higher proportions of 
infants with delayed immunisation and markedly lower timeli¬ 
ness for consecutive doses. Furthermore, little improvement was 
achieved the last decade. Respectively 2.9%, 3.6% and 6.4% of infants 
received DTP3 before or at the recommended age of 16 weeks (+6 
days) in 2005, 2008 and 2012. Although the incidence of pertus¬ 
sis showed a decreasing trend in Belgium since 2007, there is still 
circulation of the disease, as is illustrated by an increasing num¬ 
ber of reported cases through mandatory notification in Flanders 
in 2012 [12,13], Among the 42 infant cases reported that year, 57% 
were 3-11 months old. Timely vaccination, is therefore increasingly 
important. 

Age-appropriate vaccination reported in several studies in low 
and middle-income countries varies substantially, with delayed 


vaccination ranging from 19 to 78% for the first dose of measles 
containing vaccines (MCV1), and from 18 to 90% for pertussis 
containing vaccines [22-25], However, definition of delay is not 
consistent and recent reports on timing of infant vaccinations in 
high-income countries are rare. A study in Switzerland reports 
delayed vaccination for MCV1 in 22% of vaccinated infants, com¬ 
parable to what is observed in Flanders, but with a low vaccination 
coverage (62.6%) [20], No data are comparable to our study for per¬ 
tussis containing vaccines. The results presented here illustrate that 
timely vaccination is an issue even in high income countries with 
high coverage. 

Reducing delay and aiming for infant immunisation at the ear¬ 
liest appropriate age in Flanders was prioritized after the 2005 
survey, when high levels of coverage had been reached. Timely vac¬ 
cination is an explicit goal for “Child and Family” (Kind & Gezin), 
the main supporting organisation of the well baby clinics in Flan¬ 
ders. They have made active efforts to enhance timeliness, mainly 
by raising awareness of nurses and physicians and by sending 
reminders through email or telephone (SMS), but are currently 
limited by the capacity of their services. 

4.2. Risk factors for remaining delay 

Despite the achievement of high coverage rates and the 
increased adherence to recommended age of administration, fur¬ 
ther improvement of timely vaccination remains an important goal 
in Flanders. Several risk factors for delay were identified in our 
study, the main ones being vaccinated outside well baby clinics 
and having a mother originating from outside the European Union. 
A higher ranking of the child within the family and a lower income 
were risk factors for some of the vaccines or doses studied. Both 
were also identified as risk factors for delayed vaccination in a study 
in 31 low and middle income countries, in Uganda and in the US 
[22,23,26]. Special attention is thus needed for children born in 
larger families or with origins outside Europe as well as for children 
vaccinated outside well baby clinics. In addition, delay due to illness 
or logistic reasons should be limited and well followed up through 
an efficient reminder system. In a study in the US, 60% of children 
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with missed vaccine opportunities did not receive age-appropriate 
immunisations within 6 months [27], Sufficient vaccine supply at 
private physician’s offices is essential to avoid delayed vaccination. 
This might improve in 2014, when the use of Vaccinnet will be 
mandatory for ordering free of charge vaccines in Flanders, allow¬ 
ing an efficient delivery of the vaccines at private practices as well. 
This electronic vaccination database could also be used to iden¬ 
tify children with missing doses and recall them for vaccination in 
a timely way, as is the case in some other immunisation informa¬ 
tion systems (IIS) [28], Furthermore, since timely vaccination scores 
higher in well baby clinics, sufficient resources should be allocated 
to these clinics, to ensure a continuous and adequate service to the 
population. 

Finally, emphasizing the importance of timeliness is needed in 
the communication to parents as well as physicians. 

4.3. Limitations of the study 

When using time-to-event analysis, we assumed that any dose 
which was not yet given at the moment of the interview was in fact 
a delayed dose, which could still be given at any time after the inter¬ 
view. Because of this assumption, we cannot exclude that part of 
the gain in timeliness was due to improving access to computerized 
vaccination data. Increased use over the study time period of Vac¬ 
cinnet allowed better documentation of vaccines administered at 
well baby clinics and by private physicians, which are increasingly 
registering vaccinations in this system since 2006 [16], However, 
this effect is limited since in each survey intense efforts were made 
to retrieve additional data from medical files. 

The Cox regression we used, identified factors related with “an 
older age at vaccination”, comparing with the mean age at vaccina¬ 
tion in the reference group. A multiple regression analysis on the 
2012 survey data that evaluated risk factors for being not (yet) fully 
vaccinated at 18 months of age, corresponding to a considerable 
delay for any of the studied vaccines, identified ranking (or num¬ 
ber of children), mother’s age and main vaccinator as determinants, 
similar to the results in this study (not shown) [10], 

5. Conclusions 

Routine evaluation of vaccination programmes is based on mea¬ 
suring vaccine uptake (vaccine coverage), however relying only on 
vaccination coverage may mask important delays in vaccination 
and subsequent lack of immunity, leading to a false assumption of 
disease protection. 

Our data demonstrate that compliance to recommendations on 
timing of infant vaccines in Flanders increased over the past decade. 
Nevertheless, further improvement is necessary, especially for DTP, 
to optimize control of pertussis. This is possible through target¬ 
ing infants who are at risk for delay. The barriers contributing to 
delay in vaccination and possible measures to improve timeliness 
identified in our study may also apply to similar settings in other 
European countries. 
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